Audio file interface

ABSTRACT

Methods, systems, and computer-readable medium for providing an audio file interface. In one implementation, a method is provided. The method includes, while playing an audio file on a mobile device and displaying a current view in a user interface of the mobile device, receiving first user input requesting that an audio interface be displayed, and displaying the audio interface as an overlay in the user interface, where the audio interface includes information associated with the audio file.

TECHNICAL FIELD

The subject matter of this patent application is generally related toinformation presentation.

BACKGROUND

Conventional mobile devices often include an interactive user interface.Typically, a user can input information into the user interface tomanipulate/configure/operate the mobile device. For example, the usermay enter input such as text, motions, uploads, voice commands, or otherinformation to perform tasks on the mobile device. In someimplementations, the user interface can be configured to output orpresent information related to the user input to the user. The devicemay produce as output an effect based on the user input. For example, auser input can cause the mobile device to turn on or off.

Whether providing input or receiving output, users generally want to beable to control the system and assess the state of the system at somepoint in time. As such, the design of a user interface can affect theamount of effort expended by a user in providing input to andinterpreting output from the system. In addition, the design may dictatehow much effort is spent to learn how to input entries and interpretoutput. Accordingly, usability and aesthetics can be considered indesigning user interfaces for mobile devices.

SUMMARY

A technique, method, apparatus, and system are described to provide anaudio file interface. In general, in one aspect, a method is provided.The method includes, while playing an audio file on a mobile device anddisplaying a current view in a user interface of the mobile device,receiving first user input requesting that an audio interface bedisplayed, and displaying the audio interface as an overlay in the userinterface, where the audio interface includes information associatedwith the audio file.

Implementations can include one or more of the following features. Theoverlay can be partially transparent. The audio interface can bedisplayed as an overlay over the current view displayed in the userinterface. In response to the first user input, a new view can bedisplayed in the user interface, where the new view includes an imageassociated with the audio file, and the audio interface is displayed asan overlay over the new view displayed in the user interface.

Implementations can include one or more of the following features. Thetransition from displaying the current view in the user interface todisplaying the new view in the user interface can be animated. In onetransition animation, a shrinking of the current view in the userinterface can be followed by an expanding of the new view in the userinterface. In another transition animation, the current view can slideoff a vertical edge of the user interface, and the new view can slide onfrom another vertical edge of the user interface. In yet anotheranimation, a wiping away of the current view from a horizontal edge ofthe user interface to reveal the new view as it appears from a samehorizontal edge of the user interface is animated. A radial wiping awayof the current view in the user interface to reveal the new view in theuser interface can be animated. An enlarging burning hole in the currentview in the user interface can be animated, with an increasing portionof the new view being displayed inside the enlarging burning hole. Inanother animation transition, an expanding ripple can be animated, withthe current view fading out and the new view fading in as the rippleexpands.

Implementations can include one or more of the following features. Theinformation associated with the audio file included in the audiointerface can include one or more of a performer, a song, an album, atrack number, an elapsed time, or a remaining time. The informationassociated with the audio file included in the audio interface caninclude a link to a resource where the audio file is accessible, suchthat selection of the link displays content from the resource. The audiointerface can include one or more user interface elements for changingthe playing of the audio file. The one or more user interface elementscan allow one or more of changing a volume level, pausing, stopping,skipping to a point in the audio file, or skipping to another audiofile. The method can include, while the audio interface is displayed inthe user interface, receiving second user input requesting that theaudio interface not be displayed, and in response to the second userinput, displaying the current view in the user interface without theaudio interface. The mobile device can include a multi-touch-sensitivedisplay.

In one aspect, a method is provided. The method includes receiving inputat a mobile device, where the mobile device includes a user interfacewith an interface element, determining a state of the interface elementor a context of the mobile device, and in response to the receivedinput, performing a predetermined action based on the determination.

Implementations can include one or more of the following features. Thepredetermined action can be displaying a particular interface on themobile device. The input can be received at a single hardware button fornavigating the user interface of the mobile device.

In one aspect, a mobile device is provided. The mobile device includes amulti-touch-sensitive display, a user interface with an interfaceelement, and a hardware button, where selection of the hardware buttoncauses the mobile device to display a particular interface, and theparticular interface is based on a determination of a state of theinterface element or a context of the mobile device. Implementations caninclude the following feature. The hardware button can be for navigatingthe user interface of the mobile device.

In one aspect, a computer-readable medium is provided. Thecomputer-readable medium has instructions stored thereon, which, whenexecuted by a processor, causes the processor to perform operationsincluding receiving input at a mobile device including a user interfacewith an interface element, determining a state of the interface elementor a context of the mobile device, and in response to the receivedinput, performing a predetermined action based on the determination.

Implementations can include one or more of the following features. Thepredetermined action can be displaying a particular interface on themobile device. The input can be received at a single hardware button fornavigating the user interface of the mobile device.

DESCRIPTION OF DRAWINGS

FIG. 1A is a block diagram of an example mobile device.

FIG. 1B is a block diagram of an example mobile device.

FIG. 2 is a block diagram of an example network operating environmentfor the mobile devices of FIGS. 1A-1B.

FIG. 3 is a block diagram of an example implementation of the mobiledevices of FIGS. 1A-1B.

FIG. 4 illustrates an example implementation of a software stack for themobile devices of FIGS. 1A-1B.

FIG. 5 is a set of screen shots depicting example user interface contenton a mobile device.

FIG. 6A illustrates an example process for performing a predeterminedaction on a mobile device based on the context of the mobile device orthe state of an interface element.

FIG. 6B illustrates an example process for presenting an overlay in auser interface on a mobile device.

FIG. 7 is a sequence of screen shots depicting a shrink and expandanimation effect on a mobile device.

FIG. 8 is a sequence of screen shots depicting a slide animation effecton a mobile device.

FIG. 9 is a sequence of screen shots depicting a wipe away animationeffect on a mobile device.

FIG. 10 is a sequence of screen shots depicting a radial wipe animationeffect on a mobile device.

FIG. 11 is a sequence of screen shots depicting a ripple animationeffect on a mobile device.

FIG. 12 is a sequence of screen shots depicting a burning hole animationeffect on a mobile device.

DETAILED DESCRIPTION Example Mobile Device

FIG. 1A is a block diagram of an example mobile device 100. The mobiledevice 100 can be, for example, a handheld computer, a personal digitalassistant, a cellular telephone, a network appliance, a camera, a smartphone, an enhanced general packet radio service (EGPRS) mobile phone, anetwork base station, a media player, a navigation device, an emaildevice, a game console, or a combination of any two or more of thesedata processing devices or other data processing devices.

Mobile Device Overview

In some implementations, the mobile device 100 includes atouch-sensitive display 102. The touch-sensitive display 102 canimplement liquid crystal display (LCD) technology, light emittingpolymer display (LPD) technology, or some other display technology. Thetouch-sensitive display 102 can be sensitive to haptic and/or tactilecontact with a user.

In some implementations, the touch-sensitive display 102 can comprise amulti-touch-sensitive display 102. A multi-touch-sensitive display 102can, for example, process multiple simultaneous touch points, includingprocessing data related to the pressure, degree, and/or position of eachtouch point. Such processing facilitates gestures and interactions withmultiple fingers, chording, and other interactions. Othertouch-sensitive display technologies can also be used, e.g., a displayin which contact is made using a stylus or other pointing device. Someexamples of multi-touch-sensitive display technology are described inU.S. Pat. Nos. 6,323,846, 6,570,557, 6,677,932, and 6,888,536, each ofwhich is incorporated by reference herein in its entirety.

In some implementations, the mobile device 100 can display one or moregraphical user interfaces on the touch-sensitive display 102 forproviding the user access to various system objects and for conveyinginformation to the user. In some implementations, the graphical userinterface can include one or more display objects 104, 106. In theexample shown, the display objects 104, 106 are graphic representationsof system objects. Some examples of system objects include devicefunctions, applications, windows, files, alerts, events, or otheridentifiable system objects.

Example Mobile Device Functionality

In some implementations, the mobile device 100 can implement multipledevice functionalities, such as a telephony device, as indicated by aphone object 110; an e-mail device, as indicated by the e-mail object112; a network data communication device, as indicated by the Web object114; a Wi-Fi base station device (not shown); and a media processingdevice, as indicated by the media player object 116. In someimplementations, particular display objects 104, e.g., the phone object110, the e-mail object 112, the Web object 114, and the media playerobject 116, can be displayed in a menu bar 118. In some implementations,device functionalities can be accessed from a top-level graphical userinterface, such as the graphical user interface illustrated in FIG. 1A.Touching one of the objects 110, 112, 114, or 116 can, for example,invoke corresponding functionality.

In some implementations, the mobile device 100 can implement networkdistribution functionality. For example, the functionality can enablethe user to take the mobile device 100 and provide access to itsassociated network while traveling. In particular, the mobile device 100can extend Internet access (e.g., Wi-Fi) to other wireless devices inthe vicinity. For example, mobile device 100 can be configured as a basestation for one or more devices. As such, mobile device 100 can grant ordeny network access to other wireless devices.

In some implementations, upon invocation of device functionality, thegraphical user interface of the mobile device 100 changes, or isaugmented or replaced with another user interface or user interfaceelements, to facilitate user access to particular functions associatedwith the corresponding device functionality. For example, in response toa user touching the phone object 110, the graphical user interface ofthe touch-sensitive display 102 may present display objects related tovarious phone functions; likewise, touching of the email object 112 maycause the graphical user interface to present display objects related tovarious e-mail functions; touching the Web object 114 may cause thegraphical user interface to present display objects related to variousWeb-surfing functions; and touching the media player object 116 maycause the graphical user interface to present display objects related tovarious media processing functions.

In some implementations, the top-level graphical user interfaceenvironment or state of FIG. 1A can be restored by pressing a button 120located near the bottom of the mobile device 100. In someimplementations, each corresponding device functionality may havecorresponding “home” display objects displayed on the touch-sensitivedisplay 102, and the graphical user interface environment of FIG. 1A canbe restored by pressing the “home” display object.

In some implementations, the top-level graphical user interface caninclude additional display objects 106, such as a short messagingservice (SMS) object 130, a calendar object 132, a photos object 134, acamera object 136, a calculator object 138, a stocks object 140, aweather object 142, a maps object 144, a notes object 146, a clockobject 148, an address book object 150, and a settings object 152.Touching the SMS display object 130 can, for example, invoke an SMSmessaging environment and supporting functionality; likewise, eachselection of a display object 132, 134, 136, 138, 140, 142, 144, 146,148, 150, and 152 can invoke a corresponding object environment andfunctionality.

Additional and/or different display objects can also be displayed in thegraphical user interface of FIG. 1A. For example, if the device 100 isfunctioning as a base station for other devices, one or more“connection” objects may appear in the graphical user interface toindicate the connection. In some implementations, the display objects106 can be configured by a user, e.g., a user may specify which displayobjects 106 are displayed, and/or may download additional applicationsor other software that provides other functionalities and correspondingdisplay objects.

In some implementations, the mobile device 100 can include one or moreinput/output (I/O) devices and/or sensor devices. For example, a speaker160 and a microphone 162 can be included to facilitate voice-enabledfunctionalities, such as phone and voice mail functions. In someimplementations, an up/down button 184 for volume control of the speaker160 and the microphone 162 can be included. The mobile device 100 canalso include an on/off button 182 for a ring indicator of incoming phonecalls. In some implementations, a loud speaker 164 can be included tofacilitate hands-free voice functionalities, such as speaker phonefunctions. An audio jack 166 can also be included for use of headphonesand/or a microphone.

In some implementations, a proximity sensor 168 can be included tofacilitate the detection of the user positioning the mobile device 100proximate to the user's ear and, in response, to disengage thetouch-sensitive display 102 to prevent accidental function invocations.In some implementations, the touch-sensitive display 102 can be turnedoff to conserve additional power when the mobile device 100 is proximateto the user's ear.

Other sensors can also be used. For example, in some implementations, anambient light sensor 170 can be utilized to facilitate adjusting thebrightness of the touch-sensitive display 102. In some implementations,an accelerometer 172 can be utilized to detect movement of the mobiledevice 100, as indicated by the directional arrow 174. Accordingly,display objects and/or media can be presented according to a detectedorientation, e.g., portrait or landscape. In some implementations, themobile device 100 may include circuitry and sensors for supporting alocation determining capability, such as that provided by the globalpositioning system (GPS) or other positioning systems (e.g., systemsusing Wi-Fi access points, television signals, cellular grids, UniformResource Locators (URLs)). In some implementations, a positioning system(e.g., a GPS receiver) can be integrated into the mobile device 100 orprovided as a separate device that can be coupled to the mobile device100 through an interface (e.g., port device 190) to provide access tolocation-based services.

In some implementations, a port device 190, e.g., a Universal Serial Bus(USB) port, or a docking port, or some other wired port connection, canbe included. The port device 190 can, for example, be utilized toestablish a wired connection to other computing devices, such as othercommunication devices 100, network access devices, a personal computer,a printer, a display screen, or other processing devices capable ofreceiving and/or transmitting data. In some implementations, the portdevice 190 allows the mobile device 100 to synchronize with a hostdevice using one or more protocols, such as, for example, the TCP/IP,HTTP, UDP and any other known protocol. In some implementations, aTCP/IP over USB protocol can be used, as described in U.S. ProvisionalPatent Application No. 60/945,904, filed Jun. 22, 2007, for “MultiplexedData Stream Protocol,” which provisional patent application isincorporated by reference herein in its entirety.

The mobile device 100 can also include a camera lens and sensor 180. Insome implementations, the camera lens and sensor 180 can be located onthe back surface of the mobile device 100. The camera can capture stillimages and/or video.

The mobile device 100 can also include one or more wirelesscommunication subsystems, such as an 802.11b/g communication device 186,and/or a Bluetooth™ communication device 188. Other communicationprotocols can also be supported, including other 802.x communicationprotocols (e.g., WiMax, Wi-Fi, 3G), code division multiple access(CDMA), global system for mobile communications (GSM), Enhanced Data GSMEnvironment (EDGE), etc.

Example Mobile Device

FIG. 1B is a block diagram of an example mobile device 101. The mobiledevice 101 can be, for example, a handheld computer, a personal digitalassistant, a network appliance, a camera, a network base station, amedia player, a navigation device, an email device, a game console, or acombination of any two or more of these data processing devices or otherdata processing devices. In some implementations, device 101 shown inFIG. 1B is an example of how device 100 can be configured to display adifferent set of objects. In some implementations, device 101 has adifferent set of device functionalities than device 100 shown in FIG.1A, but otherwise operates in a similar manner to device 100.

Mobile Device Overview

In some implementations, the mobile device 101 includes atouch-sensitive display 102, which can be sensitive to haptic and/ortactile contact with a user. In some implementations, the mobile device101 can display one or more graphical user interfaces on thetouch-sensitive display 102 for providing the user access to varioussystem objects and for conveying information to the user.

Mobile Device Functionality

In some implementations, the mobile device 101 can implement multipledevice functionalities, such as a music processing device, as indicatedby the music player object 124, a video processing device, as indicatedby the video player object 125, a digital photo album device, asindicated by the photos object 134, and a network data communicationdevice for online shopping, as indicated by the store object 126. Insome implementations, particular display objects 104, e.g., the musicplayer object 124, the video player object 125, the photos object 134,and store object 126, can be displayed in a menu bar 118. In someimplementations, device functionalities can be accessed from a top-levelgraphical user interface, such as the graphical user interfaceillustrated in FIG. 1B. Touching one of the objects 124, 125, 134, or126 can, for example, invoke corresponding functionality.

In some implementations, the top-level graphical user interface ofmobile device 101 can include additional display objects 106, such asthe Web object 114, the calendar object 132, the address book object150, the clock object 148, the calculator object 138, and the settingsobject 152 described above with reference to mobile device 100 of FIG.1A. In some implementations, the top-level graphical user interface caninclude other display objects, such as a Web video object 123 thatprovides functionality for uploading and playing videos on the Web. Eachselection of a display object 114, 123, 132, 150, 148, 138, and 152 caninvoke a corresponding object environment and functionality.

Additional and/or different display objects can also be displayed in thegraphical user interface of FIG. 1B. In some implementations, thedisplay objects 106 can be configured by a user. In someimplementations, upon invocation of device functionality, the graphicaluser interface of the mobile device 101 changes, or is augmented orreplaced with another user interface or user interface elements, tofacilitate user access to particular functions associated with thecorresponding device functionality.

In some implementations, the mobile device 101 can include one or moreinput/output (I/O) devices 160, 162, 164, and 166, a volume controldevice 184, sensor devices 168, 170, 172, and 180, wirelesscommunication subsystems 186 and 188, and a port device 190 or someother wired port connection described above with reference to mobiledevice 100 of FIG. 1A.

Network Operating Environment

FIG. 2 is a block diagram of an example network operating environment200. In FIG. 2, mobile devices 202 a and 202 b each can represent mobiledevice 100 or 101. Mobile devices 202 a and 202 b can, for example,communicate over one or more wired and/or wireless networks 210 in datacommunication. For example, a wireless network 212, e.g., a cellularnetwork, can communicate with a wide area network (WAN) 214, such as theInternet, by use of a gateway 216. Likewise, an access device 218, suchas an 802.11g wireless access device, can provide communication accessto the wide area network 214. In some implementations, both voice anddata communications can be established over the wireless network 212 andthe access device 218. For example, the mobile device 202 a can placeand receive phone calls (e.g., using VoIP protocols), send and receivee-mail messages (e.g., using POP3 protocol), and retrieve electronicdocuments and/or streams, such as web pages, photographs, and videos,over the wireless network 212, gateway 216, and wide area network 214(e.g., using TCP/IP or UDP protocols). Likewise, in someimplementations, the mobile device 202 b can place and receive phonecalls, send and receive e-mail messages, and retrieve electronicdocuments over the access device 218 and the wide area network 214. Insome implementations, the mobile device 202 a or 202 b can be physicallyconnected to the access device 218 using one or more cables and theaccess device 218 can be a personal computer. In this configuration, themobile device 202 a or 202 b can be referred to as a “tethered” device.

The mobile devices 202 a and 202 b can also establish communications byother means. For example, the wireless device 202 a can communicate withother wireless devices, e.g., other mobile devices 202 a or 202 b, cellphones, etc., over the wireless network 212. Likewise, the mobiledevices 202 a and 202 b can establish peer-to-peer communications 220,e.g., a personal area network, by use of one or more communicationsubsystems, such as the Bluetooth™ communication devices 188 shown inFIGS. 1A-1B. Other communication protocols and topologies can also beimplemented.

The mobile device 202 a or 202 b can, for example, communicate with oneor more services 230, 240, 250, 260, and 270 over the one or more wiredand/or wireless networks 210. For example, a navigation service 230 canprovide navigation information, e.g., map information, locationinformation, route information, and other information, to the mobiledevice 202 a or 202 b. A user of the mobile device 202 b can invoke amap functionality, e.g., by pressing the maps object 144 on thetop-level graphical user interface shown in FIG. 1A, and can request andreceive a map for a particular location.

A messaging service 240 can, for example, provide e-mail and/or othermessaging services. A media service 250 can, for example, provide accessto media files, such as song files, audio books, movie files, videoclips, and other media data. In some implementations, separate audio andvideo services (not shown) can provide access to the respective types ofmedia files. A syncing service 260 can, for example, perform syncingservices (e.g., sync files). An activation service 270 can, for example,perform an activation process for activating the mobile device 202 a or202 b. Other services can also be provided, including a software updateservice that automatically determines whether software updates exist forsoftware on the mobile device 202 a or 202 b, then downloads thesoftware updates to the mobile device 202 a or 202 b where the softwareupdates can be manually or automatically unpacked and/or installed.

The mobile device 202 a or 202 b can also access other data and contentover the one or more wired and/or wireless networks 210. For example,content publishers, such as news sites, RSS feeds, web sites, blogs,social networking sites, developer networks, etc., can be accessed bythe mobile device 202 a or 202 b. Such access can be provided byinvocation of a web browsing function or application (e.g., a browser)in response to a user touching the Web object 114.

Example Mobile Device Architecture

FIG. 3 is a block diagram 300 of an example implementation of the mobiledevices 100 and 101 of FIGS. 1A-1B, respectively. The mobile device 100or 101 can include a memory interface 302, one or more data processors,image processors and/or central processing units 304, and a peripheralsinterface 306. The memory interface 302, the one or more processors 304and/or the peripherals interface 306 can be separate components or canbe integrated in one or more integrated circuits. The various componentsin the mobile device 100 or 101 can be coupled by one or morecommunication buses or signal lines.

Sensors, devices, and subsystems can be coupled to the peripheralsinterface 306 to facilitate multiple functionalities. For example, amotion sensor 310, a light sensor 312, and a proximity sensor 314 can becoupled to the peripherals interface 306 to facilitate the orientation,lighting, and proximity functions described with respect to FIG. 1A.Other sensors 316 can also be connected to the peripherals interface306, such as a positioning system (e.g., GPS receiver), a temperaturesensor, a biometric sensor, or other sensing device, to facilitaterelated functionalities.

A camera subsystem 320 and an optical sensor 322, e.g., a chargedcoupled device (CCD) or a complementary metal-oxide semiconductor (CMOS)optical sensor, can be utilized to facilitate camera functions, such asrecording photographs and video clips.

Communication functions can be facilitated through one or more wirelesscommunication subsystems 324, which can include radio frequencyreceivers and transmitters and/or optical (e.g., infrared) receivers andtransmitters. The specific design and implementation of thecommunication subsystem 324 can depend on the communication network(s)over which the mobile device 100 or 101 is intended to operate. Forexample, a mobile device 100 or 101 may include communication subsystems324 designed to operate over a GSM network, a GPRS network, an EDGEnetwork, a Wi-Fi or WiMax network, and a Bluetooth™ network. Inparticular, the wireless communication subsystems 324 may includehosting protocols such that the device 100 or 101 may be configured as abase station for other wireless devices.

An audio subsystem 326 can be coupled to a speaker 328 and a microphone330 to facilitate voice-enabled functions, such as voice recognition,voice replication, digital recording, and telephony functions.

The I/O subsystem 340 can include a touch screen controller 342 and/orother input controller(s) 344. The touch-screen controller 342 can becoupled to a touch screen 346. The touch screen 346 and touch screencontroller 342 can, for example, detect contact and movement or breakthereof using any of a plurality of touch sensitivity technologies,including but not limited to capacitive, resistive, infrared, andsurface acoustic wave technologies, as well as other proximity sensorarrays or other elements for determining one or more points of contactwith the touch screen 346.

The other input controller(s) 344 can be coupled to other input/controldevices 348, such as one or more buttons, rocker switches, thumb-wheel,infrared port, USB port, and/or a pointer device such as a stylus. Theone or more buttons (not shown) can include an up/down button for volumecontrol of the speaker 328 and/or the microphone 330.

In one implementation, a pressing of the button for a first duration maydisengage a lock of the touch screen 346; and a pressing of the buttonfor a second duration that is longer than the first duration may turnpower to the mobile device 100 or 101 on or off. The user may be able tocustomize a functionality of one or more of the buttons. The touchscreen 346 can, for example, also be used to implement virtual or softbuttons and/or a keyboard.

In some implementations, the mobile device 100 or 101 can presentrecorded audio and/or video files, such as MP3, AAC, and MPEG files. Insome implementations, the mobile device 100 or 101 can include thefunctionality of an MP3 player, such as an iPod™. The mobile device 100or 101 may, therefore, include a 36-pin connector that is compatiblewith the iPod. Other input/output and control devices can also be used.

The memory interface 302 can be coupled to memory 350. The memory 350can include high-speed random access memory and/or non-volatile memory,such as one or more magnetic disk storage devices, one or more opticalstorage devices, and/or flash memory (e.g., NAND, NOR). The memory 350can store an operating system 352, such as Darwin, RTXC, LINUX, UNIX, OSX, WINDOWS, or an embedded operating system such as VxWorks. Theoperating system 352 may include instructions for handling basic systemservices and for performing hardware dependent tasks. In someimplementations, the operating system 352 can be a kernel (e.g., UNIXkernel), as described in reference to FIG. 4.

The memory 350 may also store communication instructions 354 tofacilitate communicating with one or more additional devices, one ormore computers and/or one or more servers. The memory 350 may includegraphical user interface instructions 356 to facilitate graphic userinterface processing; sensor processing instructions 358 to facilitatesensor-related processing and functions; phone instructions 360 tofacilitate phone-related processes and functions; electronic messaginginstructions 362 to facilitate electronic-messaging related processesand functions; web browsing instructions 364 to facilitate webbrowsing-related processes and functions; media processing instructions366 to facilitate media processing-related processes and functions;GPS/Navigation instructions 368 to facilitate GPS and navigation-relatedprocesses and instructions; camera instructions 370 to facilitatecamera-related processes and functions; and/or other softwareinstructions 372 to facilitate other processes and functions, e.g.,security processes and functions as described in reference to FIG. 4.The memory 350 may also store other software instructions (not shown),such as web video instructions to facilitate web video-related processesand functions; and/or web shopping instructions to facilitate webshopping-related processes and functions. In some implementations, themedia processing instructions 366 are divided into audio processinginstructions and video processing instructions to facilitate audioprocessing-related processes and functions and video processing-relatedprocesses and functions, respectively. An activation record andInternational Mobile Equipment Identity (IMEI) 374 or similar hardwareidentifier can also be stored in memory 350.

Each of the above identified instructions and applications cancorrespond to a set of instructions for performing one or more functionsdescribed above. These instructions need not be implemented as separatesoftware programs, procedures, or modules. The memory 350 can includeadditional instructions or fewer instructions. Furthermore, variousfunctions of the mobile device 100 or 101 may be implemented in hardwareand/or in software, including in one or more signal processing and/orapplication specific integrated circuits.

Software Stack and Security Process

FIG. 4 illustrates an example implementation of a software stack 400 forthe mobile devices of FIGS. 1A-1B. In some implementations, the softwarestack 400 includes an operating system (OS) kernel 402 (e.g., a UNIXkernel), a library system 404, an application framework 406, and anapplications layer 408.

The OS kernel 402 manages the resources of the mobile device 100 or 101and allows other programs to run and use these resources. Some examplesof resources include a processor, memory, and I/O. For example, thekernel 402 can determine which running processes should be allocated toa processor, processors or processor cores, allocates memory to theprocesses and allocates requests from applications and remote servicesto perform I/O operations. In some implementations, the kernel 402provides methods for synchronization and inter-process communicationswith other devices.

In some implementations, the kernel 402 can be stored in non-volatilememory of the mobile device 100 or 101. When the mobile device 100 or101 is turned on, a boot loader starts executing the kernel 102 insupervisor mode. The kernel then initializes itself and starts one ormore processes for the mobile device 100 or 101, including a securityprocess for remote access management.

The library system 404 provides various services for applicationsrunning in the application layer 408. Such services can include audioservices, video services, database services, image processing services,graphics services, etc.

The application framework 406 provides an object-oriented applicationenvironment including classes and Application Programming Interfaces(APIs) that can be used by developers to build applications usingwell-known programming languages (e.g., Objective-C, Java).

The applications layer 408 is where various applications exist in thesoftware stack 400. Developers can use the APIs and environment providedby the application framework 406 to build applications, such as theapplications represented by the display objects 104, 106, shown in FIGS.1A-1B (e.g., email, media player, Web browser, phone, music player,video player, photos, and store).

Locked/Unlocked HUD Interface

FIG. 5 is a set of screen shots depicting examples of user interfacecontent on a mobile device. A first example user interface 500 includesa touch-sensitive display 502 for providing a user access to varioussystem objects and for conveying information to the user. In someimplementations, the user can navigate to interface 500 by selecting adisplay object, such as media object 116 or music object 124 on device100 and device 101, respectively. In some implementations, the user cannavigate to interface 500 by selecting (e.g., double-tapping) a hardwarecontrol, such as button 120 on device 100 or 101, for example. Othermethods for entering the interface 500 can be possible, a few of whichwill be described below.

The user interface 500 can display a view of an audio application whichcan generally execute (e.g., play back) audio files such as songs,movies, podcasts, or other media stored in the memory of or accessed bydevice 100 or 101. In particular, the user interface 500 can display aheads-up display (HUD) audio interface 504 overlaid on a backgroundimage 506. In some implementations, the background image 506 cancorrespond to an audio track on the mobile device such as an albumgraphic or music video. In other implementations, the background imagecan correspond to an application running on the device, such as abrowser application, an email application, or a phone application, toname a few examples.

The HUD audio interface 504 can be a transparent or partiallytransparent display that presents data without obstructing the user'sview of background image 506. For example, the interface 504 can be anaudio interface displayed as an overlay to a user's current viewdisplayed in interface 500. As such, the HUD audio interface 504 can beused to simultaneously present various user interface elements in thedisplay of device 100 or 101, for example. The user interface elementscan include controls, images, or information, for example, time, date,program information, text, or other device information. As shown, theHUD audio interface 504 includes the following user interface elements:a volume slide control 508, a reverse track control 510, a forward trackcontrol 512, and a pause/play control 514. In general, the user can useany or all of the user interface elements for changing the playing ofone or more audio files.

In an example operational mode, the user can select and slide anindicator of the volume slide control 508 to change the volume level ofthe device 100 or 101 for a particular audio file playing on the device,e.g., from a playlist. A playlist can generally include a list of audiofiles a user has configured to play consecutively or randomly. As such,when a user selects a playlist, the audio files can be queued for playin device 100 or 101.

The user can also select the reverse track control 510 to skip backwardto a different point in an audio file. Similarly, the user can selectthe forward track control 512 to skip forward to a different point in anaudio file. In some implementations, the reverse track control 510 andthe forward track control 512 can be used to skip backward or forward,respectively, in an audio file playlist, artist list, song list, orother audio related list stored in device memory. The user can alsoselect the pause/play control 514 to pause or play a selected audiofile. In some implementations, a stop button (not shown) can also beselected to stop playing a particular audio file. In someimplementations, the objects in the interface 500 may not be selectableuntil the user unlocks a locking control 516, for example.

As shown, the touch-sensitive display 502 includes the locking control516. As shown, the control 516 is in a locked position and the device100 or 101 can be locked until the user slides the control 516 tounlock, or alternatively, uses another unlocking mechanism (e.g.,hardware buttons, reboot, etc.). In some implementations, the user canchoose to lock or unlock the touch-sensitive display 502 during use. Forexample, the user can slide locking control 516 into lock mode, e.g.,when listening to audio on the device while jogging or when placing thedevice in a bag, to avoid unintentionally providing input to thetouch-sensitive display 502. In some implementations, when the device isin lock mode, the user can trigger the display of the HUD audiointerface 504 by selecting (e.g., double-tapping) a hardware control,for example, button 120 on device 100 or 101. If the elements of the HUDaudio interface 504 are disabled when the lock control 516 is engaged,the user can slide the locking control 516 to an unlock state to modifyvolume or change a song, for example. In some implementations, thelocking control 516 can display directions for the user. For example,the locking control 516 shown in interface 500 includes a “slide tounlock” instruction that visually instructs the user on how to use thecontrol 516. In some implementations, fewer interface elements areprovided by the HUD audio interface 504 when the locking control 516 isengaged than the number of interface elements provided by a HUD audiointerface when the locking control 516 is disengaged.

As shown in interface 500, the HUD audio interface 504 includes a timedisplay 518 that can display the current time of day, for example. TheHUD audio interface 504 can also include now playing information (shownhere as a song named “Baba O'Riley”), next playing information (notshown), previously played audio (not shown), audio track lengths (notshown), and other audio information, for example.

In some implementations, upon invocation of particular devicefunctionality, the graphical user interface 500 can be changed orreplaced with another user interface or user interface elements, tofacilitate user access to functions associated with the correspondinginvoked device functionality. As an example, in response to a usersliding the locking control 516, the touch-sensitive display 502 can beunlocked, and a new view can be presented in the user interface. The newview may include a different interface, for example, interface 520. Theinterface 520 depicts a HUD audio interface 522 with display elementsrelated to various audio functions. Similar to HUD audio interface 504,the HUD audio interface 522 includes audio controls for volume, fastforward, rewind, and play/pause. Additional information can be shown inthe HUD audio interface 522, such as a current song (generally in play).In this example, the current song is displayed as “Grace Finds Beauty InEverything” from the band “U2” on the album “Beautiful Day.” In someimplementations, more or less information can be shown about the currentsong. In addition, the HUD audio interface 522 provides the user withthe option to enter “iPod” mode by selecting an iPod button 524 toselect other albums, songs, or media. For example, if the user selectsiPod button 524, the user interface 520 can present an MP3/video libraryor other audio related selection within the device. The user interface520 may include various artists, songs, videos, and other mediaselectable for play or view in the user interface 520. In addition, theunlocked user interface 520 can allow the user to interact with any orall device options.

In some implementations, while the device in an unlocked mode, the usercan select a close button 526 on the HUD audio interface 522. Selectionof the close button 526 can trigger the device 100 or 101 to exit theHUD audio interface 522 and return the user to a home screen or aprevious screen 528. For example, the previous screen 528 can include anemail application as shown in FIG. 5 shadowed behind HUD audio interface522. In some implementations, the previous screen 528 may represent thescreen that was displayed in the device before the HUD audio interface522 was invoked, for example. Here, the user may have been reading orcomposing email when deciding to invoke the audio interface. In anotherscenario, the user may have been composing email while listening toaudio on the device and may wish to change (or switch to) the audiointerface at some point. The user can then change the audio output byperforming a preset action (e.g., double-tapping a hardware or softwarecontrol, selecting an audio icon, etc.). In some implementations, theuser action can trigger the display of a new user interface overlaid onthe current interface or replacing the current interface.

In some implementations, the new user interface can include an audioapplication view (e.g., the example view in user interface 500). Forexample, in response to a user-entered action, the device can displaythe audio application view of interface 500. The audio application viewcan include images or other information associated with a particularaudio file including, but not limited to, a performer, a song, an album,a track number, an elapsed time, a remaining time, album art, text,menus, or other graphics and controls. In some implementations, theaudio file information shown in an audio application view or in a HUDaudio interface can include a link to a resource where the audio file isaccessible. For example, the link can be a URL for an internet radiowebsite, and selection of the link can direct the user to the website,e.g., in a browser application on the device. The link may point to moreinformation about the audio file such as album data, album reviews,performer interviews, and more. Selecting such a link can displaycontent about the audio file and other information available from theresource.

In some implementations, the user may invoke the display of interface500, interface 520, or another interface upon performing a similaraction. For example, if the user double-taps hardware button 120, forexample, he or she may be presented with a user interface such asinterface 500, interface 520, or another interface. In particular, thesame action can bring the user to a number of different user interfacesbased on the context of the device 100 or 101, or the state of thecurrent user interface, for example.

In some implementations, the user interface presented upon userselection of an object or button may depend upon the context of thedevice 100 or 101. For example, if the user is using the phoneapplication and double-taps button 120, an address book user interfacemay be presented, for example, to assist the user with finding a phonenumber. Similarly, if the user is using the camera functionality, adouble-tap to button 120 can present a user interface for directing theuser to a storage location for a captured photograph, for example. Inyet another alternative, if the user is using the audio player, adouble-tap to button 120 can open or close an audio interface such asthe HUD audio interface of interface 500 or interface 520. For example,the user may be composing email and can double-tap button 120 to bepresented with an audio interface. In this example, the interface 520can display the HUD audio interface 522 over the view of the emailapplication. Using the HUD audio interface 522, the user can change thestate of the audio player (e.g., change a song, volume, or othersetting).

In some implementations, the user interface presented upon userselection of an object or button may depend upon the current state ofone or more user interface elements, e.g., a slider, a button, or adial. For example, when the locking control 516 is engaged, the HUDaudio interface 504 is presented upon user selection of (e.g.,double-tapping) button 120. In another scenario, if the locking control516 is disengaged, user selection of button 120 may trigger the displayof a different interface, for example, an interface with additionalinterface elements not provided with the HUD audio interface 504. InFIG. 5, the locked state of the touch-sensitive display 502 may havebeen set by the user and may remain until a user interaction changes thestate. As such, the user may unlock the touch-sensitive display 502 andthen use the HUD audio interface 504 to change one or more settings ofthe audio player.

In some implementations, the user can specify the result of selecting(e.g., doubled-tapping) a button or control through a preference menu.For example, the user can specify which user interface is displayed whenselecting button 120 while using various applications. Morespecifically, the user can use a preference menu to configure softwareand hardware control behavior while using each application, includingthe presentation of one or more types of user interfaces. For example, atransparent user interface overlay can be presented if the user selectsbutton 120 while composing text in an email, for example. In someimplementations, a new user interface can replace a presently displayeduser interface upon selection of the same button 120. For example, a newuser interface can be displayed if the user selects button 120 aftercompleting a phone call.

Context or State Specific Process

FIG. 6A illustrates an example process 650 for performing apredetermined action on a mobile device based on the context of themobile device or the state of an interface element of the mobile device.In some implementations, the method 650 can be used on mobile device 100or 101.

The process 650 begins when input is received at a mobile device, wherethe mobile device includes a user interface with an interface element(652). Generally, a user interface includes multiple interface elements.In some implementations, the input is received from a user as aselection of an object or icon displayed on the mobile device. In otherimplementations, the input is a double-tap motion on a menu control or ahardware button. In other implementations, the input is gesture inputprovided to a multi-touch-sensitive display of the mobile device.

The state of the interface element or a context of the mobile device isdetermined (654). Interface element states can include, for example, anengaged locking control, a checked check box, or a selected menu button.The context of a mobile device can include, for example, a currentlyactive application, a sleep mode, a lock mode, or an update mode.

In response to the received input, a predetermined action is performedbased on the determination of the device context or the interfaceelement state (656). In some implementations, the predetermined actioncan be the display of a particular interface (e.g., a HUD audiointerface) on the mobile device. In other implementations, thepredetermined action is the invocation of a particular application orfeature. The particular interface displayed can be previously specifiedby a user selection, e.g., in a preference menu.

HUD Overlay Display Process

FIG. 6B illustrates an example process 600 for presenting an overlay ina user interface on a mobile device. In some implementations, the method600 can be used on mobile device 100 or 101. Generally, the processincludes sending and receiving requests to modify or switch to one ormore user interfaces on a mobile device.

The process 600 begins when a user of a mobile device selects a media oran audio object (e.g., the media player object 116 of device 100 or themusic player object 124 of device 101) to execute an audio function, forexample, to play an audio file (602). Alternatively, the user can invokeplayback of one or more audio files through another icon orpre-programmed hardware control. During playback of the audio files, theuser can use other interfaces on device 100 or 101. For example, theuser can use other interfaces to compose email, schedule events, viewphotos or websites, or other tasks selectable on the mobile device. Insome implementations, the user can interrupt audio play to use phonefeatures, or other messaging features and return to audio play uponcompletion of a phone call/message. Although the audio interface may berunning in the background, the user is generally using a “current view”to perform other tasks. As such, the current view is displayed in theuser interface (604).

While playing an audio file on the mobile device and displaying anunrelated view in the user interface, the user can send a request todisplay the audio interface. The audio interface can generally include a“now playing” interface related to the audio track currently inplayback. In some implementations, the user request may be a selectionof an audio icon. In other implementations, the user request may be inthe form of a double-tap motion on a particular menu control or ahardware button. In yet other implementations, the request may be in theform of a touch or gesture predetermined by the user to invokeparticular device functionality (e.g., switch user interfacefunctionality).

In some implementations, the mobile device can detect or perform a queryto determine whether a user request to display an audio interface isreceived (606). If the user request is not received, the current viewcan remain in the user interface (e.g., user interface 500). However, ifthe request to display the audio interface is received in the system,the mobile device can display the audio interface as an overlay in theuser interface, where the audio interface includes informationassociated with one or more audio files (608). For example, in responseto the user double-tapping a hardware control button, a now playinginterface (e.g., HUD audio interface 504) can be displayed as an overlayin the user interface (e.g., the graphical user interface 500). Further,the now playing interface can include information associated with theaudio file, such as the name of a file or song, song length, albumtitle, or album length, and audio controls, such as play, rewind, orforward.

While displaying the audio interface, the mobile device can detect orperform a query to determine whether a user request is received to hideor exit the audio interface. For example, the mobile device 100 or 101can determine whether the user requested to minimize, hide, exit, orotherwise mask the audio interface. If the request is not received, themobile device can continue to display the audio interface. If therequest to not display the audio interface is received, the mobiledevice can return to displaying the current view in the user interfacewithout the audio interface (612). For example, the audio interface maybe hidden or minimized such that the user does not see the audiointerface, but the audio player continues to function (i.e., the audiofile is still in playback). In some implementations, the audio file maybe paused rather than in playback when the audio interface is minimized,hidden, or closed.

In some implementations, the device 100 or 101 can be transitioned fromone user interface to another according to user input or deviceprogramming. For example, when a user invokes an email application ondevice 100, an email user interface can be displayed on the device, andinterfaces for other applications can be minimized, closed, or otherwisereduced in the display. As such, transition screens or interfaces can bepresented between the changing of interfaces or applications. Forexample, device 100 or 101 can include animated transitions fromdisplaying the “current” view in the user interface to displaying a“new” view in the user interface.

Various animation transition techniques can be used to present a changein the user interface. In general, the techniques can include gradualtransitions from one image to another in the device display (i.e., oneview to another view in the user interface). For example, one image canbe replaced by another image with a distinct or blurry edge. The imagesdescribed in this disclosure can be actual application content (e.g.,email, audio, website, controls, or text), still images, text, andbanners, for example. In some implementations, the transition shownbetween images can also include a transition between one application andanother application. For example, device 100 or 101 can use one or moreanimated transitions to move from an email application view to an audioplayback application view. In some implementations, the display of audiointerfaces can also be animated along with any image, application, text,etc. The audio interface can remain transparent or partially transparentover any or all animated content and the interface elements of the audiointerface can be enabled when animation completes. In someimplementations, the audio interface can be transitioned before abackground image is transitioned.

In some implementations, the transition animations occur gradually overa period of time. In other implementations, the transition animationsoccur immediately upon receiving a user request. For example, the imagein the user interface can be faded, wiped, dissolved, cut away, orotherwise morphed into another image over time or instantaneously. Insome implementations, one or more animation effects can beuser-configured for each application, through a preference menu, forexample.

FIGS. 7-12 show examples of animation effects used to transition fromone view to another view in a user interface on the mobile device 100 or101. The examples below generally include a set of screen shots thatcapture the animations at different points in time. However, thesequence of events depicted can be reversed when moving from right toleft or bottom to top through the screens.

Shrink/Expand Animation

FIG. 7 is a sequence of screen shots depicting a shrink and expandanimation effect on a mobile device. In general, the shrink and expandanimation effect can be applied to images, text, video, or otherpresentable content. In certain implementations, more or less screencontent can be presented on the device between each screen shot. Assuch, the content shown in FIG. 7 is an example of the screen contentthat can be presented while using the mobile device.

The shrink and expand animation can include effects such as theshrinking of a current view in a user interface followed by an expandingof a new view in the user interface. In some implementations, the shrinkand expand animation can occur upon user request. For example, the usercan touch or provide input gesture to the device that a change in theuser interface is desired. The user touch or gesture can include adouble-tap of a control button to indicate that a change is desired inthe user interface of screen shot 702, for example. In someimplementations, the user touch or gesture can include selection of ahardware button, an icon, or other menu item.

In an example operational mode, the user indicated change can occur, forexample, when the user is viewing application data, such as a webpage704. In this example, the webpage 704 is shown in screen shot 702 andrepresents a news story accessed by the user. The user can generallyutilize the webpage 704 or another application on the device until theuser wishes to switch the content displayed in the user interface. Forexample, the user may use the webpage 704 and can decide, at some point,to switch to view an audio application view. The user can then invokethe audio application view with an audio interface by touching orproviding gesture input to the screen to trigger the desired screenchange (e.g., double-tapping a control button on the device). Inresponse to the user touch or gesture, the display of the webpage image704 can be transitioned through animation to display the requested audioapplication view. In some implementations, the animated transition caninclude gradually shrinking the webpage image 704 (shown in screen shot702) over time until the image fades away. For example, the webpageimage 704 is shown smaller in screen shot 706, smaller yet in screenshot 708, still smaller in screen shot 710, and finally barely visiblein screen shot 712.

Upon reaching a certain image dissolution, the device can begin topresent and expand a new interface image 714. The new image 714 is shownin screen shot 716 as a small view of an audio application. Theanimation continues by gradually expanding the new image 714 in screenshot 718 and finishes as a full sized image 714 in screen shot 720. Insome implementations, an audio interface 722 can be animated in the userinterface along with the audio application content. In this example, theaudio interface 722 is present in screen shot 720 with interfaceelements selectable by the user. After the animated transitioncompletes, the user can begin using the presented audio interface. Insome implementations, the animated transition can incrementally fade(while shrinking) or brighten (while expanding) over time. In someimplementations, the audio interface may be visible and usable beforethe animation effect is complete. In some implementations, the audiointerface 722 is an overlay over the view of the audio application. Inother implementations, the audio interface 722 is part of the audioapplication view.

Slide Animation

FIG. 8 is a sequence of screen shots depicting a slide animation effecton a mobile device. The slide animation can include a sliding of acurrent user interface view off of a vertical edge of the user interfacewhile sliding a new view from another vertical edge of the userinterface. In some implementations, the sliding animation can occur uponuser request. For example, the user can touch or provide input gestureto the device that a change in the user interface is desired. The usertouch or gesture can include a double-tap of a control button toindicate that a change is desired in a user interface of screen shot802, for example. In some implementations, the user touch or gesture caninclude selection of a hardware button, an icon, or other menu item.

In an example operational mode, a user may be viewing content in theuser interface of screen shot 802. The content in this example is awebpage image 804. At some point, the user can request to view differentcontent in the interface, such as an audio application view. As such,the user request can invoke the mobile device to switch to a display ofthe new user interface. For example, upon receiving the user request,the mobile device may begin the slide animation by shifting the webpageimage 804 upward and eventually off the screen of the device.

As shown in screen shot 806, the slide animation begins to appear. Forexample, the webpage image 804 is shown sliding upward as a firstportion of a new image 808 is presented in the device, for example. Overtime, the webpage image 804 can slide further upward while a new image808 slides upward below image 804 to replace image 804. Moreparticularly, the new image 808 can slide upward at a similar rate tothe rate the image 804 slides upward and thereby can replace the webpageimage 804. In some implementations, the slide transition can becompleted in less than a second.

As shown in screen shot 810, approximately half of each image 804 and808 is displayed in the user interface of the device. In this animation,image 804 slides upward while image 808 slides to replace image 804 in aportion of the screen. A screen shot 812 displays a last portion ofimage 804 and a nearly full portion of image 808. A screen shot 814displays the fully transitioned image 808 triggered by the user-enteredrequest to change content. After the slide animation effect iscompleted, the interface of screen shot 814 depicts the image 808 as aview of an audio application selectable and usable by the user of thedevice. In some implementations, an audio interface (e.g., audiointerface 816) appears as an overlay over the view of the audioapplication. In some implementations, the user may switch to the audioimage 808 briefly to change a song in play and switch back to theinitial webpage image 804 upon completion of the change song task. In asimilar fashion, the user can switch to another task and back to theaudio image 808, as desired.

In some implementations, the slide animation can occur horizontally ordiagonally across the screen of the device. In certain implementations,the sliding animation effect can occur from left to right right to left,upward, or downward. In a similar fashion, the diagonal slide effect mayoccur corner to corner from any one of the corners of the devicedisplay.

Wipe Animation

FIG. 9 is a sequence of screen shots depicting a wipe away animationeffect on a mobile device. The wipe away animation effect can include agradual horizontal transition from a current view to a new view. Forexample, the wipe away animation effect can occur along a horizontaledge in a user interface where the current view transitions off thedevice screen, while the new view transitions onto the device screen. Ineffect, the wipe away animation can appear to fade the current view infavor of the new view in a horizontal sweeping motion. Thus, a verticalline of demarcation can occur between the images. In someimplementations the line of demarcation can be blurred. In otherimplementations, the line of demarcation can be a precise divisionbetween images and can be presented in the user interface in anythickness.

In some implementations, the wipe away animation effect can occur uponuser request. For example, the user can touch or provide input gestureto the device that a change in the user interface is desired. Asdescribed above, the user touch or gesture can include a double-tap of acontrol button to indicate that a change is desired in a user interfaceof screen shot 902, for example. Other user applied motions arepossible.

In an example operational mode, a user may be viewing content in theuser interface of screen shot 902. The content in this example is awebpage image 904. At some point, the user can request to view differentcontent in the interface, such as an audio application view. Accordinglyand upon user request, the mobile device may begin the wipe awaytransition by beginning to “scroll” a horizontal edge 906. As shown inscreen shot 908, the wipe away animation is beginning to change the viewin the user interface of screen shot 902. The horizontal edge 906 isshown in screen shot 908 as a line of demarcation 910 as the two imagesscroll across the user interface. At this point, the first image 904 isshown in the right portion of the interface of screen shot 908, while asecond image 912 begins to wipe onto the left portion of the interfaceof screen shot 908. In effect, the transition can also be viewed as awiping away of the first image 904 along the line of demarcation 910 toreveal the second image 912, which appears to lie beneath the firstimage 904 in the user interface of screen shot 908.

As shown in screen shot 914, the line of demarcation 912 has progressedacross the screen to approximately half way between image 904 and image912. An audio interface 916 appears as in overlay over a lower portionof image 912. In some implementations, the user can select a controlelement in the audio interface 916 as soon as the selectable controlelement is displayed in the user interface. For example, the user canselect and use the audio interface 916 controls before the imageanimation is complete. In this example, the audio interface 916 maytemporarily disassociate with the animation if the user selects thecontrols before a particular animation transition completes.

The wipe away animation continues in screen shot 918 and can complete inscreen shot 920. Here, the new image 912 has completely replacedprevious image 904, and the user can begin using the audio applicationincluding the controls of the audio interface 916, as requested. In someimplementations, the wipe away animation effect can be performed in aclock pattern. In some implementations, the wipe away animation canoccur vertically or diagonally across the screen of the device.

Clock Wipe Animation

FIG. 10 is a sequence of screen shots depicting a clock wipe animationeffect on a mobile device. In this example, the wipe away pattern canoccur in a radial or clock hand sweep-like pattern. In particular, thecurrent view in a user interface of the mobile device can appear to bewiped away in a radial pattern to reveal the new view in the userinterface. The current view can be replaced by the new view as theanimation sweeps a radius around a center point of the interface,revealing the new view behind the sweeping radius.

As an example, a user may be viewing content in the user interface ofscreen shot 1002. The content in this example is again a webpage image1004. At some point, the user can request to view different content inthe interface, such as an audio application view, and the mobile devicemay begin the clock wipe animation by sweeping a radius around a centerpoint of the user interface. The screen shot 1006 depicts a new image1010 revealed below or replacing the current image 1004 in a radialpattern about center point 1008. As shown in screen shot 1006, theradial sweep begins at the center point 1008 pointing upward to the12:00 position on a standard analog clock. In some implementations, theclock wipe animation can be configured to begin anywhere on the screen.

In screen shots 1012, 1014, and 1016, the clock wipe animation continuesin a clockwise direction as more of the image 1010 is shown and less ofthe image 1004 is shown. In some implementations, the clock wipe can beperformed in a counterclockwise direction.

A screen shot 1018 displays the fully transitioned image 1010 resultingfrom the user-entered request to change content. After the clock wipeanimation effect is completed, the interface of screen shot 1018 depictsthe image 1010 as a view of an audio application usable by the user ofthe device. In some implementations, an audio interface (e.g., audiointerface 1020) appears as an overlay over the view of the audioapplication.

Ripple Animation

FIG. 11 is a sequence of screen shots depicting a ripple animationeffect on a mobile device. The ripple animation effect can include amoving and or an expanding ripple or ripples appearing as a moving fadeout of the current view and a moving fade in of a new view. In general,the ripple animation can spread outward over a user interface from aninitial location until the new user interface is displayed. In someimplementations, the ripple animation can appear to mimic a wave motionor undulation.

Turning to screen shot 1102, a user may be viewing a webpage image 1104and wish to switch the view to an audio application view with a nowplaying audio interface on the mobile device. As such, the user mayrequest to view an audio application view, such as the example view inuser interface 500, for an audio application on the mobile device. Asshown in screen shot 1106, the device can begin to animate the ripple1108 upon receiving the user's request. The ripple 1108 shows a newimage 1110 partially superimposed on the surrounding webpage image 1104.

Now turning to screen shot 1112, the ripple animation effect isaffecting a larger portion of the images 1104 and 1110. Similarly, thescreen shots 1114, 1116, and 1118 show blends between the images 1104and 1110. In some implementations, over time, the effect can begin todampen as the ripple resonates through the user interface. At somepoint, the webpage image 1104 may become out of focus andsemi-transparent as it fades away and image 1110 ripples into view inthe user interface. The screen shots 1118 and 1120 show the fading ofimage 1104 and the emerging of image 1110, respectively. A screen shot1122 shows the new image 1110, and the user can begin using the newlydisplayed audio application in the user interface of screen shot 1122.In some implementations, an audio interface (e.g., audio interface 1124)appears as an overlay over the view of the audio application.

Burning Hole Animation

FIG. 12 is a sequence of screen shots depicting a burning hole animationeffect on a mobile device. The burning hole animation can be a wipeanimation that wipes away the current view in a particular shape (e.g.,a circle or a star) in the user interface. In the example shown in FIG.12, the shape is a circular wipe that appears to burn an enlargingcircular iris through a current view thereby revealing or replacing the“burned” view with a new view. In some implementations, the burning holeanimation may use a shrinking animation rather than an enlarginganimation to replace user interface images. Other shapes for the holeare possible.

Similar to the above described examples, while viewing the userinterface of screen shot 1202 containing a webpage image 1204, the userof the device can request a user interface change. For example, the usermay request to view an audio application view with a now playinginterface, such as the example view in user interface 500, for an audioapplication on the device. As shown in screen shot 1206, the device canbegin to animate a burning hole 1208 upon receiving the user's request.The burning hole 1208 shows a new image 1210, while the surroundingimage is that of webpage image 1204.

Referring to screen shot 1212, a larger portion of the image 1210 isdisplayed through the enlarging opening of the burning hole 1208. Theuser interface of screen shot 1212 still contains portions of webpageimage 1204, but less so than in screen shot 1206. Similarly, the burninghole 1208 is larger in screen shot 1214 and larger yet in screen shot1216. Finally, the burning hole animation is shown completed in screenshot 1218. Here, the new image 1210 is fully visible in the userinterface, whereas image 1204 has “burned away.” In someimplementations, an audio interface (e.g., audio interface 1220) appearsas an overlay over the view of the audio application, as represented byimage 1210. In this example, the burning hole 1208 is shown beginningfrom the center outward. However, in some implementations, the burninghole may begin anywhere on the user interface.

In some implementations, a dissolve animation effect can be used totransition from one image to another. For example, an image in a userinterface can gradually transition to another image by interpolation. Inparticular, the device can gradually interpolate between the red, green,and blue (RGB) values of each pixel of the first image and the RGBvalues of each corresponding pixel of the second image. The dissolveanimation can soften the first image while sharpening the second image.At some point, the two images may appear blurred together until thefirst image is “dissolved” and the second image is brought in focus.

In some implementations, a matrix wipe animation can be used totransition from one view to another view in the user interface of thedevice. For example, a patterned transition can be programmed to wipefrom one view to another. The matrix wipe can use various patterns, suchas a grid, stars, boxes, pixels, etc.

In some implementations, the user can configure the device 100 or 101with the desired animation effects. In some implementations, oneanimation effect can be assigned to any or all user interface changes.For example, the user can configure the device 100 or 101 to display aparticular wipe effect when switching from any application view to anaudio application view, such as the example view in user interface 500.In other implementations, the user can configure separate animationeffects for each transition in the user interface of the mobile device.

The described features can be implemented advantageously in one or morecomputer programs that are executable on a programmable system includingat least one programmable processor coupled to receive data andinstructions from, and to transmit data and instructions to, a datastorage system, at least one input device, and at least one outputdevice. A computer program is a set of instructions that can be used,directly or indirectly, in a computer to perform a certain activity orbring about a certain result. A computer program can be written in anyform of programming language (e.g., Objective-C, Java), includingcompiled or interpreted languages, and it can be deployed in any form,including as a stand-alone program or as a module, component,subroutine, or other unit suitable for use in a computing environment.

Suitable processors for the execution of a program of instructionsinclude, by way of example, both general and special purposemicroprocessors, and the sole processor or one of multiple processors orcores, of any kind of computer. Generally, a processor will receiveinstructions and data from a read-only memory or a random access memoryor both. The essential elements of a computer are a processor forexecuting instructions and one or more memories for storing instructionsand data. Generally, a computer will also include, or be operativelycoupled to communicate with, one or more mass storage devices forstoring data files; such devices include magnetic disks, such asinternal hard disks and removable disks; magneto-optical disks; andoptical disks. Storage devices suitable for tangibly embodying computerprogram instructions and data include all forms of non-volatile memory,including by way of example semiconductor memory devices, such as EPROM,EEPROM, and flash memory devices; magnetic disks such as internal harddisks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROMdisks. The processor and the memory can be supplemented by, orincorporated in, ASICs (application-specific integrated circuits).

To provide for interaction with a user, the features can be implementedon a computer having a display device such as a CRT (cathode ray tube)or LCD (liquid crystal display) monitor for displaying information tothe user and a keyboard and a pointing device such as a mouse or atrackball by which the user can provide input to the computer.

The features can be implemented in a computer system that includes aback-end component, such as a data server, or that includes a middlewarecomponent, such as an application server or an Internet server, or thatincludes a front-end component, such as a client computer having agraphical user interface or an Internet browser, or any combination ofthem. The components of the system can be connected by any form ormedium of digital data communication such as a communication network.Examples of communication networks include, e.g., a LAN, a WAN, and thecomputers and networks forming the Internet.

The computer system can include clients and servers. A client and serverare generally remote from each other and typically interact through anetwork. The relationship of client and server arises by virtue ofcomputer programs running on the respective computers and having aclient-server relationship to each other.

A number of implementations have been described. Nevertheless, it willbe understood that various modifications may be made. For example,elements of one or more implementations may be combined, deleted,modified, or supplemented to form further implementations. As yetanother example, the logic flows depicted in the figures do not requirethe particular order shown, or sequential order, to achieve desirableresults. In addition, other steps may be provided, or steps may beeliminated, from the described flows, and other components may be addedto, or removed from, the described systems. Accordingly, otherimplementations are within the scope of the following claims.

What is claimed is:
 1. A method comprising: while playing an audio fileon a mobile device and displaying a current view in a user interface ofthe mobile device, receiving first user input requesting that an audiointerface be displayed; displaying the audio interface as an overlay inthe user interface, the audio interface including information associatedwith the audio file; receiving a selection of an element of the audiointerface while the mobile device is locked; and adjusting playback ofthe audio file based on the selection.
 2. The method of claim 1, wherethe overlay is partially transparent.
 3. The method of claim 1, wheredisplaying the audio interface as an overlay in the user interfacefurther comprises: displaying the audio interface as an overlay over thecurrent view displayed in the user interface.
 4. The method of claim 1,further comprising: in response to the first user input, displaying anew view in the user interface, the new view including an imageassociated with the audio file, where the audio interface is displayedas an overlay over the new view displayed in the user interface.
 5. Themethod of claim 4, further comprising: animating the transition fromdisplaying the current view in the user interface to displaying the newview in the user interface.
 6. The method of claim 5, where animatingthe transition further comprises: animating a shrinking of the currentview in the user interface followed by an expanding of the new view inthe user interface.
 7. The method of claim 5, where animating thetransition further comprises: animating a sliding of the current viewoff a vertical edge of the user interface and a sliding of the new viewon from another vertical edge of the user interface.
 8. The method ofclaim 5, where animating the transition further comprises: animating awiping away of the current view from a horizontal edge of the userinterface to reveal the new view as it appears from a same horizontaledge of the user interface.
 9. The method of claim 5, where animatingthe transition further comprises: animating a radial wiping away of thecurrent view in the user interface to reveal the new view in the userinterface.
 10. The method of claim 5, where animating the transitionfurther comprises: animating an enlarging burning hole in the currentview in the user interface, an increasing portion of the new view beingdisplayed inside the enlarging burning hole.
 11. The method of claim 5,where animating the transition further comprises: animating an expandingripple, the current view fading out and the new view fading in as theripple expands.
 12. The method of claim 1, where the informationassociated with the audio file included in the audio interface includesone or more of a performer, a song, an album, a track number, an elapsedtime, or a remaining time.
 13. The method of claim 1, where the audiointerface includes one or more user interface elements for changing theplaying of the audio file.
 14. The method of claim 13, where the one ormore user interface elements allow one or more of changing a volumelevel, pausing, stopping, skipping to a point in the audio file, orskipping to another audio file.
 15. The method of claim 1, furthercomprising: while the audio interface is displayed in the user interfaceof the locked mobile device, receiving second user input requesting thatthe audio interface not be displayed; and in response to the second userinput, displaying the current view in the user interface without theaudio interface.
 16. The method of claim 1, where the mobile deviceincludes a multi-touch-sensitive display.
 17. A method comprising:receiving input at a mobile device, the mobile device including a userinterface with an interface element; determining that the mobile deviceis in a locked state; in response to the received input and based on thedetermination, presenting an audio interface on the mobile device thatallows manipulation of an audio file with the mobile device is in thelocked state; receiving a selection of a graphical control displayed onthe audio interface while the mobile device is in the locked state; andadjusting playback of the audio file on the locked mobile device basedon the selection.
 18. The method of claim 17, where the audio interfacepresents controls for controlling playback of the audio file.
 19. Themethod of claim 17, where the input is received at a single hardwarebutton.
 20. A non-transitory computer-readable medium havinginstructions stored thereon, which, when executed by a processor, causesthe processor to perform operations comprising: receiving input at amobile device, the mobile device including a user interface with aninterface element; determining that the mobile device is a locked state;in response to the received input and based on the determination,presenting an audio interface for manipulating an audio file while themobile device is in the locked state; receiving a selection of agraphical control displayed on the audio interface while the mobiledevice is in the locked state; and adjusting playback of the audio fileon the locked mobile device based on the selection.
 21. Thecomputer-readable medium of claim 20, where the audio includes controlsfor controlling playback of the audio file on the mobile device.
 22. Thecomputer-readable medium of claim 20, where the input is received at asingle hardware button.